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ABSTRACT 

This  report  provides  the  macrobehavior  of  development  costa 
and  estimates  for  these  five  systems:  (1)  PERSHING  missile  system; 

(2)  SERGEANT  missile  system;  (3)  M561  (GAMA  GOAT)  truck;  (4)  SHERIDAN 
vehicle;  and  (5)  Advanced  Serial  Fire  Support  System  <AAFSS)<AH.56a). 
The  STEC  plot  is  developed  to  present  the  normalised  development  data. 
A  new  RDTE  quantitative  macrobehavior  measure,  the  EFFICACY  RATING, 
is  developed  to  describe,  not  judge,  the  development  phase  of  a 
weapon  system. 
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I.  INTRODUCTION 


"When  we  face  up  to  the  problem  of  developing  a  substantial 
C operations  research)  theory  we  see  that,  aa  In  all  science,  two 
complementary  approaches  are  open  to  us,  (1)  to  gather  facta  and 
(11)  to  formulate  hypotheses  or  concepts.  The  plain  truth  la  that 
we  have  very  few  of  either."  These  were  the  words  of  Dr,  E.  R.  R. 
Holmberg  (reference  1),  Director  of  Operational  Science  and 
Research,  The  British  War  Office. 

This  "fact-gathering"  report  presents  the  case  histories  of 
estimates  of  development  costs  for  several  military  systems.  Peck 
and  Scherer  (reference  2)  did  the  initial  work  of  this  type  in 
their  comprehensive  analysis  of  the  development  costs  of  twelve 
aircraft  and  missile  systems.  They  computed  that  the  average 
development  cost  factor  for  the  twelve  Air  Force  systems  was  3.2 
where  the  development  cost  factor  was  defined  as  the  actual  development 
cost  divided  by  the  original  development  cost  estimate.  It  is  the 
purpose  of  this  report  to  present  historic  estimates  of  development 
costs  and  the  final  approved  development  programs  for  these  systems: 

1.  M361  (GAMA  GOAT)  truck 

2.  Advanced  Aerial  Fire  Support  System  (AAFSS) 

3.  PERSHING  missile 

A.  SERGEANT  missile 


5.  SHERIDAN  vehicle 
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The  term  "development  coats"  moans  the  costs  included  in  the 

i 

Research-Development-Teet-Eveluation  <RDTK)  phase  of  the  overall 

program.  The  format  for  the  data  display  is  a  normalised  graph  with 

a  dimensionless  time  ratio  on  the  abscissa  and  a  dimensionless  cost  ' 

ratio  (the  inverse  of  the  Peck-Scherer  development  factor)  on  the 

ordinate.  This  particular  format  is  called  a  STEC  PLOT  since  it 

arose  from  a  "Study  of  Trends  and  Escalation  of  Costs"  by  the 

author  at  the  Hoadquarters,  US  Army  Materiel  Command.  It  was  far 

easier  to  get  data  for  the  final  approved  RDTE  program  than  it  was 

for  estimates  of  future  development  costs  where*  for  example,  in 

one  case  the  estimates  were  made  14  years  ago.  The  various  source 

documents  were  not  self-consistent  in  all  cases  and  various  adjustments 

and  corrections  had  to  be  made.  No  doubt  every  researcher  in  old 

cost  estimates  has  found  this  to  be  the  case.  The  source  documents 

are  quoted. 

System  managers  should  be  aware  of  these  trends  and  historical 
data.  It  is  emphasized  that  these  data  and  resultant  plots  are 
descriptive  and  not  normative.  No  attempt  is  made  here  to  say  that 
these  trends  are  desirable  or,  on  the  other  hand,  particularly 
i  undesirable.  However,  the  very  fact  that  these  trends  have  occurred 

with  some  degree  of  regularity  in  the  past  suggests  that  future  systems 
f  may  also  exhibit  the  characteristic  rise  of  the  (e/C)  curve  (see 

section  II)  to  about  the  same  degree. 
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These  data  Indicate  the  magnitude  of  the  poet  understatement 
of  development  costs.  Section  VII  gives  the  general  reasons  for 
the  understating 

This  is  not  an  analysis  or  critique  of  a  particular  system. 
These  happened  to  be  readily  available  date. 
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II.  M3 61  (GAMA  GOAT)  Truck 


Tha  M561  I. 25  ton  truck  is  a  diosol  ongino  powered, 
lightweight,  articulated  vehicle  with  selective  two  or  aU  wheel 
dtivo.  It  is  intended  thot  the  M561,  initially  called  tho  GAMA  GOAT 
truck,  will  perform  a  combat  support  role  during  crosscountry 

operations.  Reference  3  is  the  cost-effuctivenosa  study  for  this 
vehicle. 

Figure  1  is  the  development  STEC  plot. 


Figure  1.  STEC  PLOT?  M561  (GAMA  GOAT)  TRUCK 


The  constant  C  is  the  total  development  cost. 

Tho  constant  T  le  tho  development  time  as  measured  either 
from  tho  earliest  available  astimoto  or  the  start  of  the  actual 
development  program  to  tho  completion  of  the  RDTE  phase* 

Tho  values  of  C  and  T  oto  classified  CONFIDENTIAL  and  will  not 
bo  givan  in  this  unclassified  report. 

The  letter  o  represents  the  estimate  of  total  RDTE  costs  mado 
at  time  t,  and  the  letter  c  represents  the  cumulative  RDTE  ctual 
program  costs  up  to  time  t. 

The  dots  on  the  STEC  plot  are  plotted  points  representing  an 
actual  estimate  or  cumulative  program  at  £  particular  timei  In 
tho  sections  which  follow  the  dots  are  omitted  at  higher  values  of 
time  when  both  curves  approach  unity. 

Th<  ratio  (e/C)  is  a  measure  of  tie  accuracy  or  the  uncertainty 
of  the  estimate  e  mode  at  time  t.  Its  inverse  at  time  t.  -  0,  i.e., 
(C/e),  is  the  Pcck-Schoror  development  cost  factor,  which  in  this 
case  would  be  4.76.  The  (o/C)  value  at  time  t  0,  1  March  1960. 
was  0,21  which  means  that  tho  initial  estimate  was  21  percent  of 
the  final  RDTE  cost.  The  ratio  (c/C)  shows  how  the  approved  program 
varied  as  a  function  of  time. 

The  data  sources  were.1 

1.  The  US  Army  Ordnance  Corps  RDTE  Command  Schedules  of  1960, 
1961,  and  1962. 
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2 .  US  Army  Materiel  Corimand  RDTE  Command  Schedules  of 
1963  and  1965. 

3.  Project  Manager's  Master  Plans. 

4.  M561  Technical  Development  Plan. 


III.  Advanced  Aerial  Fire  Support  System  (AAFSS) 

The  Advanced  Aerial  Fire  Support  System  (AAFSS),  designated 
the  AH-56A  Cheyenne,  is  a  rotary  wing  vehicle  developed  specifically 
as  an  integrated  weapons  system.  The  system  is  a  two-place  compound 
vehicle  and  all  avionic,  fire  control,  and  weapons  equipment. 
Reference  4  is  the  cost-effectiveness  study. 

Figure  2  gives  the  partial  development  STEC  plot.  Since  this 
project  will  not  complete  its  RDTE  phase  until  FY-1971,  these  data 
are  therefore  an  interim,  rather  than  a  final  presentation. 
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NORMALIZED  TIMES  /  J_  J 

Symbol*  \"**  / 

C  -  Total  •  mount  ol  actual  RDTE  cost*  Final.  (Dollar*) 

T  »  Tlmo  ported  from  dot*  of  Inlltol  RDTE  aatlmate  to  completion  ol  RDTE  pbaae.  ( Years ) 
e  •  Estimate  of  total  ROTE  coots  made  el  time  S.  (Doliare)  fit,  Z 

c  -  Cumulative  RDTE  actual  coeta  up  to  time  I.  (Dollars) 


Figure  2,  STEC  PLOT:  AH-56A  SYSTEM 
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The  data  sources  were: 

1.  US  Army  Materiel  Command  RDTE  Command  Schedules  of 
1963,  1965,  1966  and  1967. 

2.  Project  Manager's  "AAFSS  Cost  Estimate"  of  1964. 

3.  Project  Manager's  Master  Plans. 
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IV.  PERSHING  I  Weapons  System 

The  PERSHING  I  Weapon  System  provides  nuclear  fire  power  for 
general  support  of  the  field  army  and  army  group.  PERSHING  I  Is  a 
mobile,  surface-to-surface,  ballistic  missile  system  capable  of 
fulfilling  an  extended  range  nuclear  fl.'e  mission.  The  missile 
(XMGM-31A)  is  a  multiple-stage,  solid  propellant,  inertially  guided 
missile. 

Figure  3  gives  the  development  STEC  plot  for  the  PERSHING  I 
and  does  not  include  PERSHING  IA. 
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NORMALIZED  TIMES  /  ) 

Symbol*  \  T  / 

C  -  Total  amount  of  actual  RDTE  coala  Final,  (Dollar*) 

T  -  Tima  parted  from  data  ol  Initial  ROTE  aatlmato  to  complatlon  ol  ROTE  phaaa*  (Yaara) 
a  •  Eatlmato  of  total  ROTE  coat#  mad*  al  tlmo  t.  (Dollar#) 
c  ■  CurrvuJativa  RDTE  actual  coata  up  to  tlma  t,  (Dollars) 


Figure  3.  STEC  PLOT:  PERSHING  SYSTEM  (WITHOUT  la) 
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The  data  sources  were: 

1.  Pershing  Missile  System  Flans  of  ;.958,  1959,  and  I960* 

2.  Project.  Managers  Master  Plans* 

3.  US  Army  Materiel  Command  RDTE  Command  Schedules  of  1963, 
1965,  1966,  and  1967. 

9.  Pershing  RDTE  Program  Status,  5  March  1968* 

5.  US  Army  Ordnance  Corps  Command  Schedules  of  1960,  1961, 
and  1962. 
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The  data  sources  were? 


1,  Guided  Missile  Programs  Data  for  Symington  Comnittee, 

19  April  1956. 

2,  SERGEANT  Weapon  System  RDTE  Funding  Summary,  provided  by 
Project  Manager's  office  on  15  February  1968. 

3,  "THE  SERGEANT  Program",  Report  Number  20-137,  Jet  Propulsion 
Laboratory,  Pasadena,  California,  l  October  1960, 

4,  US  Army  Materiel  Command  RDTE  Command  Schedules  of  1963,  1965, 
1966,  and  1967. 

5,  US  Army  Ordnance  Corps  Command  Schedules  of  1960,  1961,  and 
1962. 
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VI,  SHERIDAN  System 

The  General  Sheridan  is  a  full-tracked  amphibious  armored 
reconnaissance/airborne  assault  vehicle  armed  with  a  152-mm 
gun-launcher  cannon  that  can  fire  either  a  guided  missile  or 
conventional  ammunition. 

Figure  5  gives  the  development  STEC  plot. 


O.IO  o.ao  O.JO  0. 40  0,50  0,00 


o,oo  o.oo 


-NORMALIZED  TIMES  /  1  \ 

Symbol*  - - S —  ( 

C  .  Total  amount  ol  actual  RDTE  coal.  Final,  (Dollar*) 

:  *  mrv;r;:  &  zr -  ROTE 

0  •  CumulaUv*  ROTE  actual  coat*  up  to  Urn*  t,  (Dollar*) 


Figure  5.  STEC  PLOT:  SHERIDAN  SYSTEM 
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The  data  sources  were: 

1*  Project  Manager's  Master  Plans 

2.  US  Army  Materiel  Command  RDTE  Command  Schedules  of  1963, 
1965,  1966,  and  1967, 

3,  US  Army  Ordnance  Corps  Command  Schedules  of  1960,  1961, 
and  1962, 
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VII.  efficacy  rating 

Since  this  is  a  fact-gathering  report  and  not  an  analysis, 
specific  comments  on  the  latter  will  not  be  given.  However,  it  con 
be  said  in  general  that  the  causes  for  tho  increasing  trend  in  develop¬ 
ment  costs  are  (i)  inflationary  trend  of  the  economy;  (2)  changes  in 
the  configuration  of  the  system  being  developed,  usually  toward  a 
more  complex  system;  (3)  development  program  stretchout;  (4)  the 
transitional  process  which  the  purely  engineering-based  cosc  estimates 
undergo  when  converted  into  budget  estimates!  and  (5)  orrors  in  the 
cost-estimating  relationships  with  the  bias  for  development  estimates 
on  the  low  side. 

Figure  6  gives  the  range  of  the  (e/C)  curve  for  four  systems, 
that  is,  Gamma  Goat,  Sergeant,  Pershing,  and  Sheridan  systems.  The 
(e/C)  MEAN  curve  is  the  arithmetic  mean  of  the  (e/c)  curves  of  the 
four  systems.  The  (e/C)  HIGH  curve  is  a  composite  of  tho  highest 
(e/C)  value  of  the  four  systems  for  a  particular  value  of  (t/T). 

The  (e/C)  LOW  curve  is  a  composite  of  the  lowest  (e/C.)  values.  The 
value  of  the  reciprocal  of  (e/C)  MEAN  at  time  •  0  is  2,4  which  Is  to 
be  compared  with  the  Pock-Scherer  value  of  3.2,  This  lower  value  was 
expected  since  the  four  Army  systems  are  less  complex  than  the  twelve 
Air  Force  systems  selected  by  Peck  and  Scherer. 

A  new  measure  of  the  development  process,  the  EFFICACY  RAT1NC , 
i9  given  where  the  EFFICACY  RATING  (E)  is  a  quantitative  measure 


(ranging  from  0  to  1*0)  to  describe*  not  judgo*  tho  development 
phase  of  a  weapons  system.  Previously  defined  RDTE  measures 
lnciudet  (a)  total  RDTE  cost  C  in  dollacsj  (b)  total  RDTE  duration 
T  in  years;  and  (c)  the  development  coat  factor  (d.c.f.)  of  Peck  and 
Scherer  (reference  2).  Tho  3TEC  plots  display  those  measures  in 
normalited  format  where  the  value  of  the  (e/C)  curve  at  (t/T)  «=>  0 
corresponds  to  the  development  cost  factor. 


(«/C)  moil 


IMSH 


Symbol*  \^  ) 

J  *  Total  amount  ot  aolual  RDTE  00*1*  F*lr.al,  (Dollar#) 

T  .  T|m*  p*rto<J  from  d*la  ol  Initial  HOTS  .ailm.t*  to  oomplallon  o)  RDTE  pi,.,.  (V».r*l 
*  «  ffaltmal*  o!  101*1  RDTB  ooata  mad*  al  Urn*  (Doll.r.)  ^ 

«  •  0,«iut*llv*  ROTE  actual  ooata  up  to  ilm*  t,  (dollar*) 


Figure  6.  STEC  PLOT;  RANGE  OF  (c/C)  CURVES  FOR  FOUR  SYSTEMS 
(GAMA  GOAT,  SERGEANT,  PERSUING,  AND  SHERIDAN) 


These  three  macrobohavior  measures  while  useful  are  not  complete. 
See  Figure  7.  The  curve  A-B,  labeled  g(t)  is  the  (c/C)  curvoi  the 
g(t)  notation  is  used  to  indicate  that  the  curve  is  a  function  of 
time.  Curves  f^(t)  and  f^(t)  are  the  (e/C)  curves  made  respectively 
by  Managor  Number  One  (Ml)  and  Manager  Ntsnber  Two  (M2),  The  C,  T, 
and  d.  c.  f.  values  are  equal.  But  the  utilities  of  the  estimates 
made  by  the  two  managers  are  not  the  same.  Assuming  that  both 
managers  hove  access  to  the  same  data,  ceteris  paribus ,  M2  by  inspection 
of  the  STEC  plot  is  the  better  manager  in  the  sense  that  his  estimates 
of  the  RDTE  phase  of  this  project  are  more  meaningful.  Ml  i6  more 
passive  and  changes  hia  estimates  only  as  the  actual  coats  change. 


r 


Figure  7.  STEC  PLOT  WITH  ESTIMATING  BY  TWO  MANAGERS 


3RMAUZEO  COSTS 
AND  ESTIMATES 


M2,  at  (t/T)  =  0.25,  gives  an  estimate  that  is  0.90  C.  Ml  at  the 
same  time  gives  an  estimate  that  is  0.30  C.  M2  has  realized  that 
his  first  estimate  was  low  and  within  a  reasonably  short  time  has 
produced  a  good  one.  Ml  reacts  slowly  and  changes  his  estimates 
only  as  g(t)  increases. 

The  perfect  manager  (Figure  8)  always  estimates  f(t)  equal  to 
C. 


I 
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Figure  8.  STEC  PLOT  OF  THE  ’’PERFECT"  MANAGER 
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The  perfectly  imperfect  manager  (Figure  9)  always  estimates  f(t) 
equal  to  g(t).  Real  world  managers  estimate  somewhere  between 
these  extremes. 


W 


NORMALIZED  TIMES 

Symbol* 

C  •  Tottl  « mourn  ol  *clu*l  ROTE  co-it*  F|r>*l.  (Dollar*) 

T  -  Ttm*  parlod  Irom  data  ol  lnlll*l  ROTE  osUmal*  lo  eompUtlon  ol  ROTE  pbasa.  (V**r*) 
*  »  Eattmata  ol  lolal  RDTE  coal*  mad*  ai  Him  t,  (Dollar*) 
e  »  Cumulatlva  RDTE  actual  coal*  up  lo  tlma  t.  (Dollar*) 


Figure  9.  STEC  PLOT  OF  THE  "PERFECTLY  IMPERFECT"  MANAGER 


The  area  for  comparison  is  A-G-F-B  of  Figure  7.  No  attempt 
to  judge  the  shape  of  the  g(t)  curve  will  be  made.  As  the  f(t)  curve 
follows  the  F-B  line  the  higher  should  be  the  rating.  As  the  f(t) 
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curve  follows  the  A-B  line  the  lower  should  be  the  rating.  The 
rating  will  be  called  the  EFFICACY  RATING  and  will  be  denoted  by  the 
capital  letter  E.  This  title  avoids  the  confusion  which  could  arise 
by  calling  the  rating  "efficiency"  or  "effectiveness". 

Mathematically,  the  Efficacy  Rating  is  defined  as: 


and  g(t)  =  (c/C)  curve  on  a  STEC  plot. 

The  perfect  manager  (Figure  6)  has  E  equal  to  1.0.  The  perfectly 
imperfect  (Figure  9)  manager  has  E  equal  to  0. 

Note  that  E  is  a  quantitative  measure  to  describe  the  shapes 
of  two  curves.  Figure  10  is  a  table  showing  possible  combinations 
and  reasons  for  the  ratings.  A  low  E  value  indicates  something  went 
wrong  but  a  high  E  value  does  not  necessarily  insure  that  everything 
went  right.  The  Judgment  of  the  decision  maker  is  still  required  to 
interpret  the  E  rating. 
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Description  of 
Manager's  Estimates 


Grossly  overestimates  RDTE 
cost  either  through  ignorance 
or  desire  to  play  it  safe. 


Excellent  cost  estimate. 


Grossly  underestimates  RDTE 
costs  either  through 
Ignorance  or  desire  to  "get 
his  foot  in  the  door." 

Excellent  cost  estimate. 


Low  Cost  Estimate. 


Description  of  Development  Efficacy 

Laboratory's  Performance  Rating  (E) 

Poor.  Expends  more  funds  High:  0.9 

than  necessary.  Possibly  or  1,0 

pads  bill  so  as  to 
exactly  meet  manager's 
cost  estimate. 


Excellent  performance. 


Satisfactory  performance. 


Poor  performance. 
Expends  more  funds 
than  necessary. 

Poor  performance. 


High:  0.9 
or  1.0 

Low:  0.1 
or  0.2 


Low:  0.1 

0.2 


Low :  0,1 
or  0.2 


Figure  10.  PERFORMANCE  COMBINATIONS  RESULTING  IN  HIGH  OR  LOW  EFFICACY 
RATINGS 


ihe  EFFICACY  RATINGS(E)  for  four  systems  are  given  below: 


SYSTEM 

PERSHING  missile 
GAMA  GOAT  truck 
SERGEANT  missile 
SHERIDAN  vehicle 
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